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Abstract. We give a unified treatment to optimization problems that can be ex- 
pressed in the form of nonnegative-real-weighted Boolean constraint satisfaction prob- 
lems. Creignou, Khanna, Sudan, Trevisan, and Williamson studied the complexity of 
approximating their optimal solutions whose optimality is measured by the sums of out- 
comes of constraints. To explore a wider range of optimization constraint satisfaction 
problems, following an early work of Marchetti-Spaccamela and Romano, we study the 
case where the optimality is measured by products of constraints' outcomes. We com- 
pletely classify those problems into three categories: PO problems, NPO-hard problems, 
and intermediate problems that lie between the former two categories. To prove this 
trichotomy theorem, we analyze characteristics of nonnegative-real-weighted constraints 



QJ • using a variant of the notion of T-constructibility developed earlier for complex- weighted 



counting constraint satisfaction problems. 

keywords: optimization problem, approximation algorithm, constraint satisfaction 
problem, PO, APX, approximation-preserving reducibility 



1 Maximization by Multiplicative Measure 

In the 1980s started extensive studies that have greatly improved our understandings of the exotic 
behaviors of various optimization problems within a scope of computational complexity theory. 
These studies have brought us deep insights into the approximability and inapproximability of 
■ optimization problems; however, many studies have targeted individual problems by cultivating 

. different and independent methods for them. To push our insights deeper, we are focused on a 

I collection of "unified" optimization problems, whose foundations are all formed in terms of Boolean 

CD I constraint satisfaction problems (or CSPs, in short). Creignou is the first to have given a formal 

treatment to maximization problems derived from CSPs [3]. The maximization constraint satisfac- 
tion problems (or MAX-CSPs for succinctness) are, in general, optimization problems in which we 
seek a truth assignment a of Boolean variables that maximizes an objective valu^ (or a measure) of 
cr, which equals the number of constraints being satisfied at once. Creignou presented three criteria 
5^ ! (which are 0-validity, 1-validity, and 2-monotonicity) under which we can solve the MAX-CSPs in 

polynomial time; that is, the problems belong to PO. 

Creignou's result was later reinforced by Khanna, Sudan, Trevisan, and Williamson [7J, who 
gave a unified treatment to several types of CSP-based optimization problems, including MAX-CSP, 
MIN-CSP, and MAX-ONE-CSP. With constraints limited to "nonnegative" integer values, Khanna 
et al. defined MAX-CSP(J-') as the maximization problem in which constraints are all taken 
from constraint set J- and the maximization is measured by the "sum" of the objective values of 



*Present Affiliation: Department of Information Science, University of Fukui, 3-9-1 Bunkyo, Fukui 910-8507, 
Japan 

function tfiat associates an objective value (or a measure) to each solution is called an objective function or (a 
measure function) . 
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constraints. For a later comparison, we call such a measure an additive measure. More formally, 
MAX-CSP(J') is defined as: 

MAX-CSP(7-): 

• Instance: a finite set H of elements of the form (/i, (xj^, . . . on Boolean variables 
xi, . . . ,Xn, where h £ J^, {ii, . . . C [n], and k is the arity of h. 

• Solution: a truth assignment a to the variables xi, • • • , 

• Measure: the sum Y,{h,x')eH K^^i^h), ■ ■ ■ ,(^ixik)), where x' = {xi^,. . . ,Xii^). 

For instance, MAX-CSP(XOi?) coincides with the optimization problem MAX-CUT, which 
is known to be MAX-SNP-complete [9]. Khanna et al. re-proved Creignou's classification the- 
orem that, for every set of constraints, if J- is one of 0-valid, 1-valid, and 2-monotone, 
then MAX-CSP(J') is in PO, and otherwise, MAX-CSP(J') is APX-complete @ under their 
approximation-preserving reducibility. This classification theorem was proven by an extensive use 
of a notion of strict/perfect implementation. 

From a different and meaningful perspective, Marchetti-Spaccamela and Romano [8] made a 
general discussion on max NPSP problems whose maximization is measured by the "products" of 
the objective values of chosen (feasible) solutions. From their general theorem follows an early 
result of [1] that the maximization problem, MAX-PROD-KNAPSACK, has a fully polynomial(- 
time) approximation scheme (or FPTAS). This result can be compared with another result of 
Ibarra and Kim [5] that MAX-KNAPSACK (with additive measures) admits an FPTAS. The 
general theorem of [8] requires development of a new proof technique, called variable partitioning. 
A similar approach was taken in a study of linear multiplicative programming to minimize the 
"product" of two positive linear cost functions, subject to linear constraints [6]. In contrast with 
the previous additive measures, we call this different type of measures multiplicative measures, and 
we wish to study the behaviors of MAX-CSPs whose maximization is taken over multiplicative 
measures. 

Our approach clearly fills a part of what Creignou |3j and Khanna et al. [7J left unexplored. Let 
us formalize our objectives for clarity. To differentiate our multiplicative measures from additive 
measures, we develop a new notation MAX-PROD-CSP(-), in which "PROD" refers to a use of 
"product" of objective values. 

MAX-PROD-CSP(jr): 

• Instance: a finite set H of elements of the form (/i, (xj^ , . . . , Xj^,)) on Boolean variables 
xi, . . . , Xn, where h £ T and {ii, . . . , ik} ^ [n]. 

• Solution: a truth assignment a to xi, . . . , x^^. 

• Measure: the product J^^^^ x')gh ^('''(^n)i • • • ) '^(^«fc))) where x' = (xj^, . . . , Xj^.). 

There is a natural, straightforward way to relate MAX-CSP(J')'s to MAX-PROD-CSP(J')'s. 
For example, consider the problem MAX-CUT and its multiplicatively-measured counterpart, 
MAX-PROD-CUT. Given any cut for MAX-CUT, we set the weight of each vertex to be 2 if 
it belongs to the cut, and set the weight to be 1 otherwise. When the cardinality of a cut is maxi- 
mized, the same cut incurs the maximum product value as well. In other words, an algorithm that 
"exactly" finds an optimal solution for MAX-CUT also computes an optimal solution for MAX- 
PROD-CUT. However, when an algorithm only tries to "approximate" such an optimal solution, 
its performance rates for MAX-CUT and for MAX-PROD-CUT significantly differ. In a case of 

"''APX is the collection of optimization problems whose optimal solutions can be (deterministically) approximated 
to within a fixed constant in polynomial time. 
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geometric programming, a certain type of product objective function is known to be "reduced" 
to additive ones if function values are all positive (see an survey [2j). In our setting, a different 
complication comes in when some values of /I's accidentally fall into zero and thus the entire prod- 
uct value vanishes. Thus, an approximation algorithm using an additive measure does not seem 
to lead to an approximation algorithm with a multiplicative measure. This circumstance indicates 
that multiplicative measures appear to endow their associated optimization problems with much 
higher approximation complexity than additive measures do. We then need to develop a quite 
different methodology for a study on the approximation complexity of multiplicatively-measured 
optimization problems. 

Within the framework of MAX-PROD-CSPs, we can precisely express many maximization 
problems, such as MAX-PROD-CUT, MAX-PROD-SAT, MAX-PROD-IS (independent set), and 
MAX-PROD-BIS (bipartite independent set), which are naturally induced from their corresponding 
additively-measured maximization problems. Some of their formal definitions will be given in 
Section 12.21 In a context of approximability, since the multiplicative measures can provide a 
richer structure than the additive measures, classification theorems for MAX-CSPs and for MAX- 
PROD-CSPs are essentially different. The classification theorem for MAX-PROD-CSPs — our main 
result — is formally stated in Theorem II. H in which we use an abbreviation, MAX-PROD-CSP*( J-"), 
to mean a MAX-PROD-CSP whose unary constraints are provided for freqj and other nonnegative- 
real-weighted constraints are drawn from T . 

Theorem 1.1 Let T he any set of constraints. If either T C AT or T ^ 8T>, then 
MAX-PROD-CSP* (J") is in PO. Otherwise, if T Q IMopt, then MAX-PROD-CSP* (J") is 
APT-reduced from MAX-PROD-BIS and is APT-reduced to MAX-PROD-FLOW. Otherwise, 
MAX-PROD-CSP* (J") is APT-reduced from MAX-PROD-IS. 

Here, "APT" stands for "approximation preserving Turing" in the sence of [3]. Moreover, AT is 
the set of "affine"-like constraints, £T> is related to the binary equality and disequality constraints, 
and IMopt is characterized by "implication" -like constraints. The problem MAX-PROD-FLOW 
is a maximization problem of finding a design that maximizes the amount of water fiow in a given 
direct graph. See Sections I2.1H2.2I for their formal definitions. 

The purpose of the rest of this paper is to prove Theorem ll.il For this purpose, we will introduce 
a new notion of Tmax-constructibility, which is a variant of the notion of T-constructibility invented 
in [TU]. This Tmax-constructibility is proven to be a powerful tool in dealing with MAX-PROD- 
CSPs. 

2 Formal Definitions and Basic Properties 

Let N denote the set of all natural numbers (i.e., nonnegative integers) and let M denote the set 
of all real numbers. For convenience, N"^ expresses N — {0} and, for each n G N"*", [n] denotes the 
integer set {1,2,..., n}. Moreover, the notation M-° stands for the set {r G M | r > 0}. 

2.1 Constraints and Relations 

Here, we use terminology given in [IQj . A (nonnegative-real- weighted) constraint is a function 
mapping from {0, l}'^ to M-*^, where k is the arity of /. Assuming the standard lexicographic 

^Allowing a free use of arbitrary unary constraints is a commonly used assumption for decision CSPs and counting 
CSPs. 
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order on {0,1}'^, we express / as a series of its output values. For instance, if A; = 2, then / is 
(/(OO), /(Ol), /(lO), /(II)). We set EQ = (1, 0, 0, 1), Aq = (1, 0), and Ai = (0, 1). 

A relation of arity /c is a subset of {0,1}'^. Such a relation can be also viewed as a function 
mapping Boolean variables to {0, 1} (i.e., x G ii iff R{x) = 1, for every x G {0, l}'^) and it 
can be treated as a Boolean constraint. For instance, logical relations OR, NAND, XOR, and 
Implies are all expressed as appropriate constraints in the following manner: OR = (0,1,1,1), 
NAND = (1,1,1,0), XOR = (0,1,1,0), and Implies = (1,1,0,1). A relation R is affine if it is 
expressed as a set of solutions to a certain system of linear equations over OF (2). An underlying 
relation Rf o{ f is defined as Rj = {x \ f{x) ^ 0}. 

We introduce the following six special sets of constraints. 

1. Let U denote the set of all unary constraints. 

2. The notation AfZ expresses the set of all non-zero constraints. 

3. Denote by T>Q the set of all constraints that are expressed by products of unary constraints, 
each of which is applied to a different variable. Such a constraint is called degenerate. 

4. Let ST? denote the set of all constraints that are expressed as products of some of unary 
constraints, the equality EQ, and the disequality XOR. 

5. The set AJ- is defined as the collection of all constraints of the form 
g{xi, . . . ,Xk)Y\j.j-iiRj{xi,Xj) for a certain fixed index i G [k], where g is in VQ and 
each Rj is an affine relation. 

6. Define IA4opt to be the collection of all constraints that are products of some of the following 
constraints: unary constraints and constraints of the form (1, 1, A, 1) with < A < 1. This is 
different from IA4 defined in |10j . 

Lemma 2.1 For any constraint f = {x,y,z,w) with x,y,z,w G M-", if xw > yz, then f belongs 
to IMopt- 

2.2 Optimization Problems with Multiplicative Measures 

A (combinatorial) optimization problem P = (/, sol,m) takes input instances of "admissible data" 
to the target problem. We often write / to denote the set of all such instances and sol(x) denotes 
a set of (feasible) solutions associated with instance x. A measure function (or objective function) 
m associates a nonnegative real number to each solution y in sol(x); that is, m{x,y) is an objective 
value (or a measure) of the solution y on the instance x. We conveniently assume m{x, y) = for 
any element y sol(x). The goal of the problem P is to find a solution y in sol(x) that has an 
optimum value (such y is called an optimal solution), where the optimality is measured by either 
the maximization or minimization of an objective value m(x, y), taken over all solutions y G sol(a;). 
When y is an optimal solution, we set m*{x) to be m{x,y). 

Let NPO denote the class of all optimization problems P such that (1) input instances and 
solutions can be recognized in polynomial time; (2) solutions are polynomially-bounded in input 
size; and (3) a measure function can be computed in polynomial time. Define PO as the class of all 
problems P in NPO such that there exists a deterministic algorithm that, for every instance x € I, 
returns an optimal solution y in sol(x) in time polynomial in the size \x\ of the instance x. 

We say that, for a fixed real-valued function a with a{n) > 1 for any input size n G N, an 
algorithm A for an optimization problem P = (I, sol, m) is an a- approximation algorithm if, for 
every instance x £ I, A produces a solution y G sol(x) satisfying that l/a(|2;|) < \m{x,y)/m*{x)\ < 
Q:(|a;|), except that, whenever m*{x) = 0, we always demand that m{x,y) = 0. Such a y is called 
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an a{n)- approximate solution for input instance x of size n. The class APX (resp., exp-APX) 
consists of all problems P in NPO such that there are a constant r > 1 (resp., an exponentially- 
boundeci^ function a) and a polynomial-time r- approximation (resp., a-approximation) algorithm 
for P. Approximation algorithms are often randomized. A randomized approximation scheme for 
P is a randomized algorithm that takes a standard input instance x (z I together with an error 
tolerance parameter e G (0, 1), and outputs a 2^-approximate solution y £ sol(x) with probability 
at least 3/4. 

Of numerous existing notions of approximation-preserving reducibilities, we choose a notion 
introduced recently by Dyer, Goldberg, Greenhill, and Jerrum [Jj, which can be viewed as a ran- 
domized variant of Turing reducibility, based on a mechanism of oracle Turing machine. Since the 
purpose of Dyer et al. is to solve counting problems approximately, we need to modify their notion 
so that we can deal with optimization problems. Given two optimization problems P = (/, sol, m) 
and Q = (/', sol', m'), a polynomial-time (randomized) approximation-preserving Turing reduc- 
tion (or APT-reduction, in short) from P to Q is a randomized algorithm that takes a pair 
(x,e) € / X (0,1) as input, uses an arbitrary randomized approximation scheme (not necessarily 
polynomial time-bounded) M for Q as oracle, and satisfies the following conditions: (i) A^ is a ran- 
domized approximation scheme for P for any choice of oracle M for Q; (ii) every oracle call made 
by A^ is of the form {w, 6) £ I' x (0, 1) satisfying 1/6 < p{\x\, 1/e), where p is a certain absolute 
polynomial, and an oracle answer is an outcome of M on the input {w,6); and (iii) the running 
time of A^ is bounded from above by a certain polynomial in (|x|, 1/e), not depending on the choice 
of the oracle M. In this case, we write P <apt Q and we also say that P is APT-reducible (or 
APT-reduced) to Q. Note that APT-reducibility composes. If P <apt Q and Q <apt P-, then P 
and Q are said to be APT- equivalent and we use the notation P =apt Q- 

In the definition of MAX-PROD-CSP(J-') given in Section (TJ we also write /i(xj^ , . . . , Xj^,) 
to mean (/i, (xj^ , . . . , Xj^.)) in H. For notational simplicity, we intend to write, for example, 
MAX-PR0D-CSP(/,7',^) instead of MAX-PROD-CSP({/} U 7" U ^). In addition, we abbrevi- 
ate as MAX-PROD-CSP*(J') the maximization problem MAX-PROD-CSP(J' U ^/). 

For any optimization problem P and any class C of optimization problems, we write P <apt C 
if there exists a problem Q G C such that P <apt Q- Our choice of APT-reducibility 
makes it possible to prove Lemma 12.21 however, it is not clear whether the lemma implies that 
MAX-PR0D-CSP(7') G exp-APX. 

Lemma 2.2 MAX-PR0D-CSP(7') <apt exp-APX for any constraint set T. 

Hereafter, we introduce the maximization problems stated in Theorem ll.il 
MAX-PROD-IS: (maximum product independent set) 

• Instance: an undirected graph G = (V,E) and a series {wx}xev of vertex weights with 

Wx G M^O; 

• Solution: an independent set A on G; 

• Measure: the product YIxi^a'^^- 

This maximization problem MAX-PROD-IS literally coincides with 
MAX-PROD-CSP(A^AAfL',^o), where Go = {[1,A] | A > 0}, and it can be easily shown to 
be NPO-complete. When all input graphs are limited to bipartite graphs, the corresponding 
problem is called MAX-PROD-BIS. 

^This function a must satisfy that there exists a positive polynomial p for which 1 < a{n) < 2^''"-' for any number 
n G N. 
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MAX-PROD-BIS: (maximum product bipartite independent set) 

• In MAX-PROD-IS, all input graphs are limited to bipartite graphs. 

Since the above two problems can be expressed in the form of MAX-PROD-CSP*(-), we can 
draw the following important conclusion, which becomes part of the proof of the main theorem. 

Lemma 2.3 1. MAX -PROD-IS <apt MAX-PROD-CSP*(Oi?). 
2. MAX-PROD-BIS <apt MAX-PROD-CSP*(/mp/ies). 

Next, we introduce a special maximization problem, called MAX-PROD-FLOW, whose intuitive 
setting is explained as follows. Suppose that water flows from point u to point v through a one-way 
pipe at flow rate P[u,v)- A value cr{x) expresses an elevation (indicating either the bottom level or 
the top level) of point x so that water runs from point u to point v whenever cr(u) > cr(v). More 
water is added at influx rate vuy at point v for which a{v) = 1. 

MAX-PROD-FLOW: (maximum product flow) 

• Instance: a directed graph G = {V,E), a series {pejesE of flow rates with pe > 1; and a 
series {wx}x£V of influx rates with Wx > 0; 

• Solution: a Boolean assignment a to V; 

• Measure: the product (U(^x,y)€EMx)><Tiy) P{x,y)) (Uzev,ai^)=iW^) ■ 

From the above definition, it is not difficult to prove the following statement. 

Lemma 2-4 For any constraint set T C IMopt, MAX-PROD-CSP*(J') is APT-reducible to 
MAX-PROD-FLOW. 

2.3 Tmax-Constructibility 

To pursue notational succinctness, we use the following notations. Let / be any arity-A; con- 
straint. For any two distinct indices i,j € [k] and any bit c G {0,1}, let /^''^^ denote the 
function g satisfying that 5(2:1, Xj+i, Xfc) = f{xi, . . . ,Xi_i,c,Xi+i, . . . ,Xk) and let 
fxi=xj ^.j^g function g defined as g{xi, . . . ,Xi-i,Xi+i, ... ,Xk) = f{xi, . . . ,Xi-i,Xj,Xi+i, . . . ,Xk). 
Moreover, we denote by maxj^j_,,,^j^^(/) the function g defined as g{xi,...,Xk) = 
maX(-j^^^ y^)g{g {/(xi, . . . , Xk, Hi, ... , yd)}, where yi, . . . ,yd are all distinct and different from 
xi, . . . , Xk, and let A • / denote the function satisfying (A • /)(xi, . . . , Xk) = A /(xi, . . . , Xk). 

A helpful tool invented in [10] for counting CSPs is a notion of T-constructibility. For our 
purpose of proving the main theorem, we wish to modify this notion and introduce a notion of Tmax- 
constructibility. We say that an arity-A: constraint / is Tmax-constructible (or Tf^ax- constructed) 
from a constraint set ^ if / can be obtained, initially from constraints in G, by applying recursively 
a finite number (possibly zero) of seven functional operations described below. 

1. Permutation: for two indices i,j € [k] with i < j, by exchanging two columns 
Xi and Xj in (xi, . . . , Xi, . . . , Xj , . . . , x^), transform g into g' , where g' is defined as 
g {xi, . . . , Xj, . . . , Xj, . . . , Xfc) = g{xi, . . . , xj , . . . , Xj, . . . , x^). 

2. Pinning: for an index i G [k] and a bit c € {0, 1}, build g^^^*^ from g. 

3. Linking: for two distinct indices i,j € [k], build g^^^^i from g. 

4. Expansion: for an index z S [A:], introduce a new "free" variable, say, y and transform g into 
g' that is defined by g'{xi, . . .,Xi,y,Xi+i, ...,Xk)= g{xi, . . . ,Xi,Xj+i, . . . ,Xfc). 
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5. Multiplication: from two constraints gi and 52 of arity k that share the same in- 
put variable series {xi, . . . ,Xk), build the constraint 171 ■ §2, where (i^i ■ g2){xi, . . . , Xk) = 
gi{xi,...,Xk)g2{xi,...,Xk). 

6. Maximization: build maxy-^^,,,^y^ ((7) from g, where yi, . . . ,yd are not shared with any other 
constraint other than this particular constraint g. 

7. Normalization: for a positive constant A, build A • g from g. 

When / is Tniax"Constructible from Q, we use the notation / ^^^^ Q- In particular, when ^ is a 
singleton {g}, we also write / <^"^ g instead of / <™^^' {g}- 

It holds that Tmax-constructibility between constraints guarantees APT-reducibility between 
their corresponding MAX-PROD-CSP*(-)'s. 

Lemma 2.5 If f <^^^ Q, then MAX-PROD-CSP*(/, J") is APT-reducible to 
MAX-PROD-CSP*(a, J^) for any constraint set T. 

3 Proof of the Main Theorem 

Our main theorem — Theorem ll.H — states that all maximization problems of the form of 
MAX-PROD-CSP*(-) can be classified into three categories. This trichotomy theorem sheds a 
clear contrast with the dichotomy theorem of Khanna et al. [7] for MAX-CSPs. Hereafter, we will 
present the proof of Theorem 11.11 

3.1 First Step Toward the Proof 

We begin with MAX-PROD-CSP*(-)'s that can be solved in polynomial time. 

Proposition 3.1 If either T <^ AT or T <^ £V , then MAX-PROD-CSP*(J") helongs to PO. 

Proof Sketch. For every target problem, as in the proof of [1^ Lemma 6.1], we can greatly 
simplify the structure of each input instance so that it depends only on polynomially many solutions. 
By examining all such solutions deterministically, we surely find its optimal solution. Hence, the 
target problem belongs to PO. ■ 

It thus remains to deal with only the case where T ^ AT and T ^ ET>. In this case, we first 
make the following key claim that leads to the main theorem. 

Proposition 3.2 Let f he any constraint and assume that f AT \J 8T>. Let T he any set of 
constraints. 

1. If f G I-Mopt, then MAX-PROD-CSP*(/mp/ies, J") is APT-reducihle to 
MAX-PROD-CSP* (/, T) . 

2. If f IMopt, then there exists a constraint g € {OR, NAND} such that 
MAX-PROD-CSP* (5, J") is APT-reducihle to MAX-PROD-CSP* (/, J"). 

We postpone the proof of the above proposition and, meanwhile, we want to prove Theorem 
11.11 using the proposition. 

Proof of Theorem 11.11 If C AT or C £T>, then Proposition 13.11 implies that 
MAX-PROD-CSP* (J") belongs to PO. Henceforth, we assume that T <^ AT and T <^ £V. If 
T C IMopt, then Lemma [211 helps APT-reduce MAX-PROD-CSP* (7") to MAX-PROD-FLOW. 
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Next, we choose a constraint f £ J- for which / AJ- U SD. Proposition 13.21 ^1) 
then yields an APT-reduction from MAX-PROD-CSP*(/mp/ies) to MAX-PROD-CSP*(/). 
By Lemma El2), we obtain MAX-PROD-BIS <apt MAX-PROD-CSP*(/mp/ies). Since 
MAX-PROD-CSP*(/) <APT MAX-PROD-CSP*(J"), it follows that MAX-PROD-BIS is APT- 
reducible to MAX-PROD-CSP*(J'). 

Finally, we assume that J-" ^ Z Adopt- Take a constraint f £ J- satisfying that 
/ ^ AJ- U £T> U ZMopt- In this case. Proposition 13.2( 2) yields an APT-reduction 
from MAX-PROD-CSP*(Ofi) to MAX-PROD-CSP*(/), since MAX-PROD-CSP*(Oi?) =apt 
MAX-PROD-CSP*(A^yliVL>). From MAX-PROD-CSP*(/) <apt MAX-PR0D-CSP*(J"), it im- 
mediately follows that MAX-PROD-CSP* (Oii) is APT-reducible to MAX-PROD-CSP^C-F). By 
Lemma ESJ^l), MAX-PROD-IS <apt MAX-PROD-CSP* (Oi?). Therefore, we conclude that 
MAX-PROD-IS is APT-reducible to MAX-PROD-CSP*(J'). □ 

3.2 Second Step Toward the Proof 

To finish the proof of Theorem II .H we still need to prove Proposition 13.21 Proving this proposition 
requires three properties. To describe them, we first review two existing notions from [10] . We say 
that a constraint / has affine support if -R/ is an affine relation and that / has imp support if -R/ is 
logically equivalent to a conjunction of a certain "positive" number of relations of the form Ao(a;), 
Ai(a;), and Implies{x,y). The notation AFFINE denotes the set of all afhne relations. 
In the following three statements, F denotes an arbitrary set of constraints. 

Lemma 3.3 If f is a non- degenerate constraint in ZAiopt (ind has no imp support, then 
MAX-PROB-CSP* {Implies, F) <apt MAX-PR0D-CSP*(/, J"). 

Proposition 3.4 Let f be any constraint having imp support. If either f has no affine support 
or f ^ £V, then MAX-PROD-CSP*(/mpZies, J") is APF-reducihle to MAX-PROD-CSP*(/, J"). 

Proposition 3.5 Let f ^ J\fZ he any constraint. If f has neither affine support nor imp sup- 
port, then there exists a constraint g G {OR, N AND} such that MAX-PR0D-CSP*(5r, J") <apt 
MAX-PROD-CSP* (/, F) . 

With a help of the above statements, we can prove Proposition 13.21 as follows. 

Proof Sketch of Proposition 13. 2L Let / ^ AF U £T> be any constraint. We proceed our proof 
by induction on the arity k of /. For the proposition's claims, (1) and (2), the basis case = 1 is 
trivial since £T) contains all unary constraints. Next, we prove the induction step /c > 3. In the 
remainder of this proof, as our induction hypothesis, we assume that the proposition holds for any 
arity less than k. The claims (1) and (2) will be shown separately. 

(1) Assume that / is in ZAdopt. If / has imp support, since / ^ £V, we can apply Proposi- 
tion 13.41 and immediately obtain the desired APT-reduction MAX-PROD-CSP* (Imp/ies, J-") <apt 
MAX-PROD-CSP* (/, J"). Otherwise, by LemmaE31 we have the desired APT-reduction. 

(2) Since / has no imp support, if Rj is not affine, then Proposition 13.51 implies that, for a 
certain g^ G {OR,NAND], MAX-PROD-CSP* (50, -7^) <apt MAX-PROD-CSP* (/, J^); therefore, 
the desired result follows. To finish the proof, we hereafter assume the affine property oi Rf. 

[Case: / G MZ] Recah that f ^ £V and Rj G AFFINE. Since / G MZ, we have \Rf \ = 2^, 
and thus / should be in clean form (i.e., / contains no factor of the form: Ao(x), A.i{x), and 
EQ{x,y)). As shown in [lOl Lemma 7.5], there exists a constraint p = {l,x,y,z) £T> with 
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xyz 7^ 0, z ^ xy, and p /• When z < xy, we can prove that, for a certain qq S {OR, NAND}, 

MAX-PROD-CSP*(5o,-7^) <APT MAX-PROD-CSP*(p, J"). In the case where z > xy, LemmaO 
impHes p € XMopt- Since p is obtained from / by pinning operations only, we conclude that 
/ G XAAapt, a contradiction. This finishes the induction step. 

[Case: / MZ] We first claim that A; > 3. Assume otherwise that k = 2. Since Rf € AFFINE, 
it is possible to write / in the form f{xi,X2) = S,A{xi,X2)g{xi) after appropriately permuting 
variable indices. This places / within AJ-, a contradiction against the choice of /. Hence, /c > 3 
holds. Moreover, we can prove the existence of a constraint g AJ- of arity m for which 2 < m < k, 
9 ^Sra^ /) ^'^d either g G AfZ or Rg ^ AFFINE. If we can show that (*) there exists a constraint 
go € {OR, NAND} satisfying MAX-PROD-CSP*(5o, -7^) <apt MAX-PROD-CSP*(g, 7"), then 
the proposition immediately follows from g <^'jf f ■ The claim (*) is split into two cases: (i) 
Rg G AFFINE and (ii) Rg AFFINE. For (i), we apply the induction hypothesis. For (ii), we 
apply Propositions I3.4M3.51 Thus, we have completed the induction step. □ 

In this end, we have completed the proof of the main theorem. The detailed proofs omitted 
in this extended abstract will be published shortly. We hope that our systematic treatment of 
MAX-PROD-CSP*s would lead to a study on a far wider class of optimization problems. 
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